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I.  The  object  of  this  study  was  to  find  a  way  to  utilize  response-l Inn 
data  In  the  scoring  proceditre  of  achlevemi'iit  tesilnp,.  The  enipirlc.il 
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learning  of  further  instructional  materials  to  a  great  extent*  This 
fact  urges  us  to  tap  what  information-processing  strategy  was  used  to 
respond  to  a  given  problem,  not  only  considering  individual  differences 
in  ability  or  achievement  level,  derived  solely  from  the  performance 
scores.  It  was  seen  that  there  were  response  patterns  which  yielded  the 
same  achievement  level  9  but  the  answers  were  obtained  by  two  different 
approaches.  If  these  individual  differences  in  information-processing 
skills  would  not  be  detected  on  a  diagnostic  test,  then  a  proactive 
Inhibition  effect  will  cause  a  serious  learning  deficiency,  even  for 
many  good  students,  upon  studying  further  instructional  materials. 

2.  A  model  useful  in  Identifying  discriminating  items  that  are 
sensitive  to  differences  in  instructional  method  was  developed.  It  also 
is  helpful  In  identifying  an  individuals^  instructional  background  to  a 
certain  extent. 

3.  A  method  chat  estimates  A  by  regressing  0  onto  test-items  was 
developed  and  compa^red  with  9  estimated  by  the  maximum  likelihood 
method.  The  new  method  provided  as  good  9  as  the  traditionally 
established  method  did.  This  method  Is  powerful  when  the  number  of 
subjects  snd  test-items  avsilable  arc  small.  Also  estimates  are  always 
obtainable,  and  moreover  free  from  a  choice  of  ordering  test-items. 
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^This  Is  the  f Inal^ •  teport  of  a  year-lonft>>proJect  which  explored 
psychometric  properties  of  response-time  data  and  developed  a  model  In 
which  response-time  was  Incorporated  In  scoring  achievement  tests. 
Validation  of  the  model  with  real  data  has  not  yet  been  done,  though  the 
foundation  of  the  model  Is  based  on  theoretical  and  empirical  research 
conducted 'by  the  principal  Investigator  and  Maurice  Tatsuoka  In  the  past 
few  years.  Many  studies  related  to  response-time  have  been  done  by 
experimental  psychologists  and  cognitive  scientists  since  the  early  years 
of  this  century.  They  first  tried  to  discover  an  empirical  relationship 
between  Intelligence  and  reaction  time  (we  call  it  response-time  in  this 
study)  In  the  perceptual  domain  but  the  results  from  various  studies  were 
so  diverse  that  convincing  relations  were  not  obtained.  Due  to  recent 
technical  advances  In  computer  science,  computerized  testing  allows  for 
more  accurate  measurement  and  control  of  time  data.  Thus  It  enabled 
cognitive  psychologists  to  provide  a  large  amount  of  Information  about  the 
relations  between  response-time  and  various  types  of  stimuli.  Moreover, 
many  psychological  studies  pertinent  to  an  Information-processing  view  of 
mental  abilities  have  indicated  the  existence  of  a  series  of  cognitive 
processes  which  differ  among  individuals.  'The  Intention  of  the  model  Is  to 
try  to  quantify  Individual  differences  in  Information-processing  skills  In 
terms  of  a  latent  response-time  variable  (analogous  to  the  ability  variable 
in  latent  trait  theory)  which  affects  the  time  taken  by  an  examinee  to 
answer  each  of  a  given  set  of  test  Items.  We  did  not  attempt  to  give  a 
precise  psychological  meaning  for  this  construct  beyond  saying  that  It  may 
be  regarded  as  a  pi'rvaslve  trait  of  Individuals  to  be  slow  or  quick  In 
solving  items  of  a  certain  domain.  T1»e  scope  of  this  study  was  summarized 


t«  Technical  Report  No.  I,  A  Model  tor  Incorporating  Response-t Ime 
Data  In  Scorlnn  Achievement  T»»st?<. 

The  other  object  of  the  project  was  to  apply  ailaptlve  testing 
techniques  to  the  Interactive  moJe  of  actual  Instructions  and  testing  with 
computer-raanajted  routing  systems.^.  The  computer-based  education  system 
at  the  University  of  Illinois  (Vl.ATOy  has  been  widely  utilized  In  teaching 
many  subject  areas  for  the  past  several  years.  Computerized  adaptive  tests  of 
s  l}?ned-numbers  operations  for  a  junior  hl^h  school,  and  of  imatrlx  algebra 
for  the  multivariate  statistics  courses  In  the  Departments  of  Psychology 
and  Educational  Psychology  at  the  I'ntversliy  i)f  Illinois,  were  Implemented 
along  with  compv\ter-managed  routing  systems  by  which  each  student  was  sent 
to  the  Instructional  unit  corrt'spondlng  to  the  level  of  achievement  at 
which  she/he  stopped  In  the  Initial  tests.  Convent  Uma 1  posttests  were 
administered  at  the  end  of  Instruction. 

The  practical  use  of  adaptive  dlagni’St Ic  testing  together  with 
computerized  Instruction  raised  Interesting  questions  and  problems.  Some 
of  the  findings  In  the  empirical  studv  were  summarized  In  Technical  Report 
No.  2,  The  Danger  of  Relying  Solely  on  Dlagni^stlc  Adaptive  Testing  when 
Prior  and  Subsequent  Inst ruct liutal  Methods  are  Different.  The 
dimensionality  of  performance  sc>'res  on  the  posttest  for  signed-numbers  was 
far  from  satisfying  \inl dlmens Iona  1 1 ty ,  while  the  scores  on  the  very  same 
test  obtained  from  the  previous  study — In  which  adaptive  diagnostic  testing 
was  not  used  and  hence  students  studied  a  whole  series  of  Instructional 
lessons--showed  a  strong  tendency  toward  unldtmenslv>nal Ity .  A  cluster 
analysis  of  the  examinees'  response  patterns  led  us  to  find  a  group  of 
students  whose  performance  on  the  test  was  significantly  different  from  the 


otluTs.  Tht'ir  scores  on  prior  to  tlie  stopping,  level  of  the 

1  ndl vf diM  1  >itij»nostlc  t<-st  were  hip.hi-r  those  of  'iiost  t-'ther  stiiiients,  while 
their  scores  v^n  tlii-  snhseqnent  items  v.’ert’  .>s  low  ;is  tht’  poorest  students' 
scores.  We  confirmed  with  their  teachers  that  most  of  them  were  actually 
■\-stndents.  We  also  confirmed  that  tlie  i.n'mhers  of  this  gri'iip  were  tanpjtt 
s  igned-niimher  addition  I'perations  by  a  teachin;’.  noth'.!  different  from  that 
of  subsequent  ins  t  rnct  i  on. 1 1  units,  which  te.acli  subtract  i.'n  .'perat  I  ons  .  The 
procedures  I'f  information  processing  associated  with  these  two  instruction.) 
methods  of  performing  arithmetic  upon  s 1 gned-niimbers  differ  greatly. 

Tor  t  ttnat  ely ,  the  response-t  ime  d.ita  that  we  observed  gave  ns  snppli'mentarv 
information  which  d  1  f  f  erent  l.tt  es  .tmong  individuals  sliowing  identlc.il 
qn.illty  of  performance.  On  the  other  h.ind,  the  tr.idltional  scoring 
procedure  of  Latent  triii  rhe.iry,  using  performance  scores,  would  not  be 
cap.ible  of  detecting  the  dl  sc  rep.inc  ies  associated  with  different 
Inforo.ation  processes  for  arriving  .at  the  answer  to  .i  given  item.  The 
empirical  study  summarl.ted  in  Technical  Report  No.  2  supports  the  notion  of 
the  new  model  Introduced  in  Technical  Report  No.  3. 

The  first  technic.il  report,  The  l.e.ist  Squares  Kstimation  of  1. a  tent 
Trait  V.ir tables  bv  a  Hilbert  Space  Approach,  describes  the  estimation 
method  of  the  latent  tr.iit  variable  bv  regressing  it  .'n  t’o'  pr>’>iictor 
vart.ables,  the  scores  of  .ill  items  used  in  .an  .idaptlve  test.  Latent  triit 
theory  has  provldi'd  tlie  only  nx'dels  th.at  .are  applic.able  to  assessing  .an 
fnilivldu.ll  student's  ability  level  in  an  .id.apt  Ive  testing  situ.it  ion  wlieii' 
e.ich  student  takes  .i  different  set  of  items.  The  estimation  of  p.ir.imet  «’rs 
of  the  latent  trait  thei'i’y  models  lias  been  achieved  iteratively  by  the 


maximum  likelihood  method.  This  meth.'d  provides  quite  accur.ite  values  for 


data  generated  by  the  Monte  Carlo  method,  but  It  often  fails  to  converge 
and  cannot  estimate  the  parameters  for  real  data  In  which  even  a  very  few 
Instances  of  certain  kinds  of  unusual  data  are  Included;  it  also  falls  for 
either  very  high  or  very  low  6  values.  This  sensitivity  is  unfortunate, 
particularly  when  adaptive  testing  is  used  in  practice,  either  as  a 
diagnostic  test  or  a  posttest  at  the  end  of  Instruction.  When  diagnostic 
adaptive  testing  is  used  for  routing  each  student  to  his/her  most 
appropriate  instructional  unit  in  a  series  of  lessons  written  on  computer- 
based  education  systems,  the  problem  of  having  nonconvergent  0  values  is 
severe.  Some  of  our  data  showed  about  10%  of  the  students  failing  to 
obtain  any  fixed  estimates  of  0  variable.  The  purpose  of  the  study 
described  in  Technical  Report  No.  1  was  to  propose  a  new  estimation  method 
by  which  estimates  of  0  are  always  obtainable  even  for  a  small  number  of 
items.  The  results  are  compared  with  those  obtained  by  the  maximum 
likelihood  method.  It  seems  that  the  least  squares  multiple  regression 
method  is  a  useful  alternative  for  providing  estimation  of  0  when  the  other 
parameters,  discriminating  power  and  difficulty,  are  known. 

ABSTRACTS  OF  RESEARCH  REPORTS 

TECHNICAL  REPORT  NO.  1 

The  Least-Squares  Estimation  of  Latent  Trait  Variables  by 
A  Hilbert  Space  Approach 

This  paper  searched  for  a  new  method  for  estimating  a  given  latent 
trait  variable  by  the  least  squares  approach.  The  beta  weights  are 
obtained  recursively  with  the  help  of  Fourier  series  and  expressed  as 
functions  of  item  parameters  of  response  curves.  The  values  of  the  latent 
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tr.ilt  varli»bl«*  estlmatoJ  by  this  method  and  by  the  maximum  likelihood  metl\od 
were  compared  iisin^  real  data.  The  results  were  very  close,  and  yet  the 
values  of  ttie  latent  trait  variable  estimated  by  the  multiple  regression 
method  were  always  o’>i  ,i ;  nable.  Tiie  imiximum  llkeliliood  metliod,  on  the  other 
hand,  often  falls  to  convergi*. 

TECHNIC Al.  REPORT  NO.  2 

The  Danger  of  Relying  Solely  On  Diagnostic  Adaptive  Testing 
When  Prior  and  Subsequent  Instructional  Methods  are  Different 

A  computerized  diagnostic  adaptive  test  for  a  series  of  pre-algebra 
signed-number  lessons  (which  are  also  on  the  computer  systeml  was 
programmed  along  wltii  a  computer-managed  routing  system  by  wlilch  each 
examinee  was  sent  to  tlie  Instructional  unit  corresponding  to  the  level  of 
skill  at  which  slie/he  stopped  in  the  initial  test.  Upon  completion  of  tiie 
course  a  computerized  conventional  posttest  was  given  to  the  examinees. 

The  posttest  scores  were  far  from  being  unidinenslonal ,  wtiile  tt\e  pretest 
and  posttest  data  obtained  from  a  previous  study,  in  w'licli  tiie  pretest  was 
a  computerized  conventional  test  and  students  were  forced  to  go  through  all 
instructional  units  regardless  of  their  achievement  in  the  pretest, 
indicated  a  stro\ig  tendency  to  be  unidimensional .  The  response  patterns  of 
the  posttest  in  the  present  study  showed  a  high  error  rate  for  tlie  skills 
prior  to  stopping  levels  for  one  subgroup  of  examiitees. 

A  cluster  analysis  was  performed  on  the  response  patterns  of  the 
skills  and  four  different  groups  were  foxind.  A  discriminant  analysis 
indicated  significant  differences  among  the  four  groups  in  response 
patterns  of  the  skills  in  signed-number  operations.  After  interviewing  the 
teachers  and  several  children,  we  came  to  the  conclusion  that  it  was  tiie 


.A 


difference  between  prior  and  current  Instructional  methods  ttiat  confused 
students  and  caused  a  mess  in  the  posttest  data.  In  other  words,  there 
was  a  proactive  inhibition  effect. 

The  scoring  procedure  ot  the  adaptive  testing  did  not  consider 
Individual  differences  In  information-processing  skills  which  were  affected 
by  the  instructional  method  used  In  previous  teaching.  Thus,  the  students 
who  were  taught  to  perform  the  beginning  part  of  a  set  of  hierarchically 
ordered  skills  by  instructional  method  A  would  very  likely  get  confused  In 
a  lesson  In  which  a  different  instructional  method  B  was  adopted. 
Consequently,  quite  a  few  peculiar  response  patterns  were  seen  in  the 
performance  on  the  posttt>st.  This  fact  cautions  us  that  one  should  be 
careful  not  to  rely  solely  on  test  resiilts  determined  by  performance  scores 
on  a  diagnostic  pretest  when  a  computer-managed  Instructional  system  is  to 
route  each  examinee  to  her/his  initial  level  of  Instruction.  It  was 
suggested  that  we  must  somehow  unravel  what  Information-processing  strategy 
was  used  and  consider  this  knowledge  simultaneously. 


effect  produces  low  achievement  scores  on  a  posttest.  This  fact  poses  a 
serious  problem  for  routing  of  students  to  an  Instructional  level  on  the 


sole  basis  of  performance  on  a  diagnostic  adaptive  test.  It  Is  essential 


that  we  somehow  unravel  what  Information-processing  strategy  was  used  and 


consider  this  knowledge  simultaneously. 

Fortunately,  response-time  often  provides  supplementary  Information 
which  differentiates  among  Individuals  showing  identical  quality  of 
performance.  A  model  that  reflects  tills  kind  of  Information,  obtainable 
from  response-time  scores.  Is  formulated  In  a  similar  manner  to  latent 
trait  theory  and  Is  discussed.  This  model  Is  useful  in  identifying 
discriminating  Items  that  are  sensitive  to  differences  In  instructional 
method.  It  also  Is  helpful  in  Identifying  an  individual's  instructional 
background  to  a  certain  extent. 
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(Code  26) 

Dept,  of  the  Navy 
Washington,  DC  20390 

John  Olsen 

Chief  of  Naval  Education  and 
Training  Support 
Pensacola,  FL  32509 

Psychologist 
ONR  Branch  Office 
495  Summer  Street 
Boston,  MA  02210 

Psychologist 
ONR  Branch  Office 
536  S.  Clark  Street 
Chicago,  IL  60605 

Office  of  Naval  Reseach 
Code  200 

Arlington,  VA  22217 


Psychologist 
ONR  Branch  Office 
1030  East  Green  Street 
Pasadena,  CA  91101 

Scientific  Director 

Office  of  Naval  Research 

Scientific  Liaison  Group/Tokyo 

American  Embassy 

APO  San  Francisco,  CA  96503 

Office  of  the  Chief  of  Naval  Operations 
Research,  Development,  and  Studies  Branch 
(OP-102) 

Washington,  DC  20350 

Scientific  Advisor  to  the  Chief  of 
Naval  Personnel  (Pers-Or) 

Naval  Bureau  of  Personnel 
Room  4410,  Arlington  Annex 
Washington,  DC  20370 

LT  Frank  C.  Petho,  MSC,  USNR  (Ph.d) 

Code  L51 

Naval  Aerospace  Medical  Research 
Laboratory 
Pensacola,  FL  32508 

Dr.  Richard  A.  Poliak 
Academic  Computing  Center 
U.S.  Naval  Academy 
Annapolis,  MD  21402 


Code  436 

Office  of  Naval  Research 
Arlington,  VA  22217 

Office  of  Naval  Research 
Code  437 

800  N.  Quincy  Street 
Arlington,  VA  22217 


Roger  W.  Remington,  Ph.D. 

Code  L52 

NAMRL 

Pensacola,  FL  32508 

Dr.  Bernard  Rimland 
Navy  Personnel  R&D  Center 
San  Diego,  CA  92152 


Personnel  &  Training  Research 
Programs  (Code  458) 

Office  of  Naval  Research 
Arlington,  VA  22217 

Psychologist 

Office  of  Naval  Research  Branch 
223  Old  Marylebone  Road 
London,  NW,  15th  England 


Mr.  Arnold  Rubenstein 
Naval  Personnel  Support  Technology 
Naval  Material  Command  (08T244) 
Room  1044,  Crystal  Plaza  //5 
2221  Jefferson  Davis  Highway 
Arlington,  VA  20360 


Army 


Pr.  Worlli  Soanl.'iiul 

riiU't  ol  Naval  KiUu'atii'ii  atul  rratiiin^', 
(•ihU«  N-S 

NAS,  rtMisai'ula,  Kl.  JL’StlS 

A.  A.  S)nlu'lm 
T«*oh.  Support,  ('oiit'  2l)l 
Navv  rorsomu' 1  K  aiut  11  CoutiT 
Sail  IM.-no,  CA  Sjnj 

Mr.  Kohort  Smith 

tlf  t  li'i'  i>t  (Miit't  I’f  Naval  Operations 
Op-i>tt/K 

Washlnuttui,  IH'  20  ISO 

Or.  Alfri'O  K.  Smoile 
Training  Analysis  aiui  Evaluation 
OriHip  (TAEi;  > 

Oopt.  of  the  Navy 
tirlaiulo,  EE  12S1J 

Ilr.  Kli'hard  Sorenson 

Navy  I’ersonnel  R  ami  0  t'enter 

San  Oiejto,  ta\  ‘)21S2 

COK  I'harles  .1.  Vlielst'n,  Or.,  MSl', 

OSN 

lli'ad  Mnmiin  Eaet  ors  Enp,  1  ne»'r  1  nn  Oiv. 
Naval  Air  Oevelopment  la'nter 
Wa  mil  ns  ter,  I’A  180  7  s 

W.  Cary  T horns (ui 

Naval  Oeeans  Systems  ('enter 

Code  7i;l2 

San  Olepo,  CA  02IS2 

Or.  RonaKI  Weit/.nvin 
Oepartment  ot  Admi  nst  rat  i v*- 
S  e  1 1'lii'es 

O.S.  Naval  I’ostpradnat  e  School 
Monterey,  (’A  0  1040 

Or.  Mart  in  K.  Wlskol t 

Navy  I’t'rsonnel  R  ami  0  ('enter 

San  Olepo,  CA  021S2 


Teehnieal  Oiri’ctiU' 

0.  S.  Armv  Resea reli  Institute  ii’r  the 
Hehavloral  and  Social  Sclenct's 
SOOl  Elsi'iihower  Avenue 
Al«-xandrla,  VA  22JJd 

11(7  USAREUE  A  7tli  Army 
OOCSOl’S 

llSAAREOE  01  rector  of  CEO 
Al’O  New  York  0')40  3 

EtUlE  Cary  lUoedorn 

Tralninp  Ef 1 ect iviMiess  Analysis  Olvlslon 
OS  Army  TRAOOC  Systems  Analysis  Activity 
White  Samis  Missile  Ranpe,  NM  88002 

Or.  Ralph  Ousek 
O.S.  Army  Research  Institute 
SOOl  E  i  s  e  nh  v'w  e  r  A  v  e  mi  e 
Alexandria,  VA  22313 

Or.  Heat  rice  .1.  Karr 

Armv  Research  Institute  (I’ERI-OK) 

SOOl  E.isenhower  Avenue 
AU'xandrla,  VA  22!133 

Or.  Myron  Eischl 

O.S.  Army  Research  Institute  tor  t he 
Social  and  Hehavtoral  Scieiu'es 
SOOl  Eisentu''wer  Avenue 
Alexandria,  VA  22133 

Or.  Ed  Johnson 

U.  S.  Army  Resi'arch  Institute 
S(H)l  Elsenhower  lllvd. 

Alexamirla,  VA  22  133 

Or.  Michael  Kaplan 
0.  S.  Army  Research  Institute 
SOOl  Eisenhower  Avenue 
Alexandria,  VA  22313 

Or.  Milton  S.  Kat/. 

Individual  Tralninp  and  Skill 
Evaluation  Technical  Area 
O.S.  Army  Research  Institute 
SOOl  Elsenhviwer  Avenue 
Alexandria,  VA  22333 


Air  Force 


Dr.  Milt  Malcr 

U.S.  Army  Research  Institute 
^001  F.isenluiwer  Avenue 
Alexandria,  VA  22333 

Dr.  Harold  F.  O'Neil,  Jr. 

Attn;  PFKI-OK 

5001  Kisenhower  Avenue 

Alexandria,  VA  22333 

Dr.  Robert  Ross 

U.S.  Army  Research  Institute  for  the 
Social  and  Behavioral  Sciences 
5001  Fisenhower  Avenue 
Alexandria,  VA  22333 

Dr.  Robert  Sasmor 

U.S.  Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences 
5001  Fisenhower  Avenue 
Alexandria,  VA  22333 

Director,  Training  Development 
U.S.  Army  Administration  Center 
ATTN:  Dr.  Sherrill 
Ft.  Benjamin  Harrison,  IN  46218 

Dr.  Frederick  Stelnhelser 
U.S.  Army  Research  Institute 
5001  Fisenhower  Avenue 
Alexandria,  VA  22333 

Dr.  Joseph  Ward 
U.S.  Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 


Air  Force  Human  Resources  Lab 
AFHRL/PED 

Brooks  AFB,  TX  78235 

Air  University  Library 
AUL/LSE  76/443 
Maxwell  AFB,  AL  36112 

Dr.  Philip  Oe  Leo 
AFHRL/TT 

Lowry  AFB,  CO  80230 

Dr.  G.  A.  Eckstrand 
AFHRL/AS 

Wrlght-Patterson  AFB,  OH  45433 

Dr.  Genevieve  Haddad 
Program  Manager 
Life  Sciences  Directorate 
AFOSR 

Bolling  AFB,  DC  20332 

CDR.  Mercer 
CNET  Liaison  Officer 
ARGRL/Flying  Training  Dlv. 
Williams  AFB,  AZ  85222 

Dr.  Ross  L.  Morgan  (AFHRL/ASR) 
Wright-Patterson  AFB 
Ohio  45433 

Dr.  Roger  Pennell 
AFHRL/TT 

Lowry  AFB,  Co  80230 

Personnel  Analysis  Division 
HQ  USAF/DPXXA 
Washington,  DC  20330 

Research  Branch 
AFMPC/DPMYP 

Randolph  AFB,  TX  78148 

Dr.  Malcolm  Ree 
AFHRL/PED 
Brooks  AFB,  TX 


78235 


U’ 


Or.  Marty  Rockway  (AFllRl./TT) 
l.owry  AFB 
Colorado  80230 

Jack  A.  Tlioqjo,  Capt,  OSAF 
Pro>;ram  Manager 
V.ife  Sciences  Olrectorate 
AFOSR 

Bolling  AFB,  OC  20332 

Brian  K.  Waters,  I.COI.,  liSAF 
Air  On  1  verity 
Maxwell  AFB 
Montgomery,  AL  3bll2 


Marines 

H.  William  Greenup 
Kducation  Advisor  (F.031) 

K  dll  c  a  t  i  on  C enter,  MCI)  KC 
Onantico,  VA  22134 

Or.  A.  I..  Slafkosky 
Scienfltlc  Advisor  (Code  RO-1 ) 
HQ,  U.S.  Marine  Corps 
Wasliington,  O.C.  20380 


lUfjist  l-iuirtl 


Other  Pul) 


Mr.  Rlchani  l.aiit ernian 
I’syi'tu*  ea  I  Research 
I'.S.  Coast  Ciiard  HQ 
Waslilaj^t  on.  Hi;  20Sd0 

Hr.  Thi'nns  Warm 
H.S.  i;oast  Ctiaril  Institute 
I’.C.  Substation  IS 
Hklah<>iika  City,  OK  7116S 


Hr.  Stepli.m  Andriole 

l/bJ)  Ad vane  ed  Research  Projects  Agency 

I sOO  Wilson  Blvd. 

Arlington,  VA  22209 

Hefense  Hoenmentat ion  Center 
Cameron  Station,  Bldg.  5 
Alexandria,  VA  22314 
Attn:  TC 

Hr.  Hexter  Fletcher 

Advanced  Research  Projects  Agency 

1400  Wilson  Blvd. 

Arlington,  VA  22209 

Hr.  William  0 rah am 
Testing  Directorate 
MF.PCOM 

Ft.  Sheridan,  II.  60037 

Military  Assistant  tor  Training  and 
Personnel  Technology 
Office  of  the  Under  Secretary  of 

Defense  for  Research  and  F.ngineerlng 
Room  3D  129,  The  Pentagon 
Washington,  Di;  20301 

Major  Wayne  Sellman,  HSAF 
Office  of  the  Assistant  Secretary 
of  Defence  (MR A  and  L) 

3B930  Tlie  Pentagon 
Washington,  DC  20301 


u 


Civil  Covernroeut 

Dr.  Susan  Chlpman 
Basic  Skills  Program 
National  Institute  of  Education 
1200  19th  Street  NW 
Washington,  DC  20208 

Dr.  William  t.orham.  Director 
Personnel  R&D  Center 
Office  of  Personnel  Managment 
1900  E  Street  NW 
Washington,  DC  204 IS 

Dr.  Joseph  I.  Llpson 
Division  of  Science  Education 
Room  W-638 

National  Science  Foundation 
Washington,  DC  20550 

Dr.  John  Mays 

National  Institute  of  Education 
1200  19th  Street  NW 
Washington,  DC  20208 

Dr.  Arnold  Helmed 
National  Institute  of  Education 
1200  19th  Street  NW 
Washington,  DC  20208 

Dr.  Andrew  B.  Molnar 
Science  Education  Dev. 
and  Research 

National  Science  Foundation 
Washington,  DC  20550 

Dr.  Lalltha  P.  Sanathanan 
Environmental  Impact  Studies  Division 
Argonne  National  Laboratory 
9700  S.  Cass  Avenue 
Argonne,  TL  60439 

Dr.  Jeffery  Schiller 
National  Institute  of  Education 
1200  19th  St.  NW 
Washington,  DC  20208 


Dr.  Thomas  G.  Stlcht 
Basic  Skills  Program 
National  Institute  of  Education 
1200  I9th  Street  NW 
Washington,  DC  20208 

Dr.  Vern  W.  Urry 
Personnel  R  and  D  Center 
U.S.  Civil  Service  Commission 
1900  E  Street  NW 
Washington,  DC  20415 

Dr.  Frank  Wlthrcs# 

U.S.  Office  of  Education 
400  6th  Street  SW 
Washington,  DC  20202 

Dr.  Joseph  L.  Young,  Director 
Memory  and  Cognitive  Processes 
National  Science  Foundation 
Washington,  DC  20550 
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Non  Government 

Dr.  Earl  A.  Allulsl 
HQ,  AFHRL  (AFSC) 

Brooks  AFB,  TX  78235 

Dr.  Erllng  B.  Anderson 
University  of  Copenhagen 
Studlestraedt 
Copenhagen 
Denma  rk 

Dr.  John  R.  Anderson 
Department  of  Psychology 
Carnegie  Mellon  University 
Pittsburgh,  PA  15213 

Dr.  Michael  Atwood 
Science  Applications  Institute 
40  Denver  Tech.  Center  West 
7935  E.  Prentice  Avenue 
Englewood,  CO  80110 

1  Psychological  Research  Unit 
Dept,  of  Defence  (Army  Office) 
Campbell  Park  Offices 
Canberra  ACT  2600,  Australia 

Dr.  Alan  Baddeley 
Medical  Research  Council 
Applied  Research  Council 
15  Chaucer  Road 
Cambridge  CB2  2EF 
England 

Dr.  Patricia  Baggett 
Department  of  Psychology 
University  of  Denver 
University  Park 
Denver,  CO  80208 

Mr.  Avron  Barr 

Department  of  Computer  Science 
Stanford  University 
Stanford,  CA  94305 

Dr.  Isaac  Bejar 
Educational  Testing  Service 
Princeton,  NJ  08450 


Dr.  Warner  Birlce 
Streitkaef teamt 
Rosenberg  5300 
Bonn,  West  Germany  D-5300 

Dr.  R.  Darrel  Bock 
Department  of  Education 
University  of  Chicago 
Chicago,  IL  60637 

Dr.  Nicholas  A.  Bond 
Dept,  of  Psychology 
Sacramento  State  College 
600  Jay  Street 
Sacramento,  CA  95819 

Dr.  Lyle  Bourne 
Department  of  Psychology 
University  of  Colorado 
Boulder,  CO  80302 

Dr.  David  G.  Bowers 
Institute  for  Social  Research 
University  of  Michigan 
Ann  Arbor,  MI  48106 

Dr.  Kenneth  Bowles 
Institute  for  Information  Sciences 
University  of  California  at  San  Diego 
La  Jolla,  CA  92037 

Dr.  Robert  Brennan 

American  College  Testing  Programs 

P.O.  Box  168 

Iowa  City,  lA  52240 

Dr.  John  S.  Brown 

XEROX  Palo  Alto  Research  Center 

3333  Coyote  Road 

Palo  Alto,  CA  94304 

Dr.  Bruce  Buchanan 
Department  of  Computer  Science 
Stanford  University 
Stanford,  CA  94304 


lb 


Or.  C.  Victor  Bunderson 
Wicat  Inc. 

University  Plaza,  Suite  10 
1 160  So.  State  St. 

Orem,  UT  8A037 

Dr.  John  B.  Carroll 
Psychometric  I-ab 
Unlv.  of  No.  Carolina 
Davie  Hall  013A 
Chapel  Hill,  NC  27514 

Charles  Meyers  Library 
Livingston  House 
Livingston  Road 
Stratford 
London  El  5  2LJ 
England 

Dr.  Micheline  Chi 
Learning  R&D  Center 
University  of  Pittsburgh 
3939  O'Hara  Street 
Pittsburgh,  PA  15213 

Dr.  William  Clancey 
Department  of  Computer  Science 
Stanford  University 
Stanford,  CA  94305 

Dr.  Kenneth  E.  Clark 
College  of  Arts  and  Sciences 
University  of  Rochester 
River  Campus  Station 
Rochester,  NY  14627 

Dr.  Norman  Cliff 
Dept,  of  Psychology 
Univ.  of  So.  California 
University  Park 
Los  Angeles,  CA  90007 

Dr.  William  Coffman 
Iowa  Testing  Programs 
University  of  Iowa 
Iowa  City,  lA  52242 


Dr.  Allan  M.  Collins 

Bolt  Beranek  and  Newnuin,  Inc. 

50  Moulton  Street 
Cambridge,  MA  02138 

Dr.  Meredltti  Crawford 
Department  of  Engineering 
Admlnlstrat Ion 
Ceorge  Washington  University 
Suite  805 

2101  L  Street  N.  W. 

Washington,  DC  20037 

Dr.  Hans  Cronbag 
Education  Research  Center 
University  of  Leyden 
Boerhaavelaan  2 
Leyden 

The  Netherlands 

Major  I.N.  Evoiilc 
Canadian  Forces  Pers.  Applied 
Research 
1107  Avenue  Road 
Toronto,  Ontario,  Canada 

Dr.  Leonard  Feldt 
Lindquist  Center  for  Measurement 
University  of  Iowa 
I  'wa  City,  lA  52242 

Dr.  Richard  L.  Ferguson 

The  American  College  Testing  Program 

P.O.  Box  168 

Ii^wa  City,  lA  52240 

Dr.  Victor  Fields 
Dept,  of  Psychology 
Montgomery  College 
Rockville,  MD  20850 

Dr.  Gerhardt  Fischer 
Lleblgasse  5 
V i enna  1010 
Austria 

Dr.  Donald  Fitzgerald 
University  of  New  England 
Armldale,  New  South  Wales  2351 
Australia 
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Dr.  Edwin  A.  Fleishman 

Advanced  Research  Resources  Organ. 

Suite  900 

4330  East  West  Highway 
Washington,  DC  20014 

Dr.  John  B.  Frederiksen 
Bolt  Beranek  and  Newman,  Inc. 

50  Moulton  Street 
Cambridge,  MA  02138 

Dr.  Robert  Glaser 
LRDC 

University  of  Pittsburgh 
3939  O'Hara  Street 
Pittsburgh,  PA  15213 

Dr.  Ira  Goldstein 

XEROX  Pala  Alto  Research  Center 

3333  Coyote  Road 

Palo  Alto,  CA  94304 

Dr.  Ross  Greene 
Palo  Alto,  CA  94304 
CTB/McGraw  Hill 
Del  Monte  Research  Park 
Monterey,  CA  93940 

Dr.  James  G.  Greeno 
LRDC 

University  of  Pittsburgh 
3939  O'Hara  Street 
Pittsburgh,  PA  15213 

Dr.  Alan  Gross 
Center  for  Advanced  Study  in 
Education 

City  University  of  New  York 
New  York,  NY  10036 

Dr.  Ron  Hambleton 
School  of  Education 
University  of  Massachusetts 
Amherst,  MA  01002 

Dr.  Chester  Harris 
School  of  Education 
University  of  California 
Santa  Barbara,  CA  93106 


Dr.  Lloyd  Humphreys 
Department  of  Psychology 
University  of  IlllnciG 
Champaign,  IL  61820 

Library 

HumRRO /Wes tern  Division 
27857  Berwick  Drive 
Carmel,  CA  93921 

Dr.  Steven  Hunka 
Department  of  Education 
University  of  Alberta 
Edmonton,  Alberta 
Canada 

Dr.  Earl  Hunt 
Dept,  of  Psychology 
University  of  Washington 
Seattle,  WA  98105 

Dr.  Huynh  Huynh 
Department  of  Education 
University  of  South  Carolina 
Columbia,  SC  29208 

Dr.  Carl  J.  Jensema 
Gallaudet  College 
Kendall  Green 
Washington,  DC  20002 

Dr.  Arnold  F.  Kanarick 
Honeywell,  Inc. 

2600  Ridgeway  Pkwy 
Minneapolis,  MN  55413 

Dr.  John  A.  Keats 
University  of  Newcastle 
Newcastle,  New  South  Wales 
Australia 

Mr.  Marlin  Kroger 
1117  Via  Goleta 

Palos  Verdes  Estates,  CA  90274 


lA'Ol..  C.K..I.  1. at  lour 
I’orsounol  Appllod  Research 
Nattoual  I'etence  IKJS 
101  I'eleuel  By  Drive 
0tt<iwa,  Can.ula  klA  OKJ 

Dr .  Mil  l.a  rk.  i  11 
Department  ot  I’syclio logy 
Oarnegte  Mellon  I'nlverslty 
I’ittsburgli.  I’A  15:13 

Dr.  Alan  I.esgolil 
Learning  K&D  Center 
Dniversity  ot  rittsbnrgh 
Pittsburgh,  PA  15:d0 

Dr.  Michael  Levine 
Department  of  Psvchology 
University  of  Illinois 
Champaign,  11.  olS:0 

Faculteit  Soctale  Wet enschappen 
R  i  j  ksun  ive  rs  1  tei t  Cron ingen 
0 ude  B o t  e r i nge s  t  raa t 
C.  roningen 
Netherlands 

Dr.  Robert  Linn 
College  of  Education 
University  of  Illinois 
Urbana,  XL  61801 

Dr.  Frederick  M.  Lord 
Educational  Testing  Service 
Princeton,  NJ  08540 

Dr.  Robert  R.  Mackie 
llunvin  Factors  Research,  Inc. 
6780  Cortona  Drive 
Santa  Barbara  Research  Pk. 
C.oleta,  CA  dJ0l7 

Dr.  Cary  Marco 
Educational  Testing  Service 
Princeton,  NJ  08^50 


Dr.  Scott  Maxwell 
Department  of  Psychology 
University  of  Houston 
Houston,  TX  77025 

Dr.  Sam  Mayo 

Loyola  University  of  Chicago 
Chicago,  IL  60601 

Dr.  Mark  Miller 

Systems  and  Information  Sciences  Lab. 
Central  Research  L.tborator ies 
Texas  Instruments,  Inc. 

Ma  i  1  St  at  ion  5 
Post  Office  Box  593b 
Dallas.  TX  75222 

Dr.  Richard  B.  Millward 
Dept,  of  Psychology 
Hunter  Lab. 

Br.wn  University 
Providence,  R1  82912 

Dr.  Allen  Munro 
Univ.  of  So.  California 
Behavioral  Technology  Labs 
3717  South  Hope  Street 
Los  Angeles,  CA  S0007 

Dr.  Donald  A.  Nornuin 
Dept,  of  Psychology  C-009 
Univ.  of  California,  San  Diego 
La  Jolla,  CA  92093 

Dr.  Melvin  R.  Novlck 
Iowa  Testing  programs 
Universitv  of  Iowa 
Iowa  City,  lA  52242 

Dr.  Jesse  Orlansky 
Institute  for  Defense  Analysis 
400  Army  Navy  Drive 
Arlington,  VA  22202 

Dr.  Seymour  A.  Papert 

Massachuset  t  s  Institvite  ot  Technology 
Artificial  Intelligence  Lab. 

545  Technology  Square 
Cam.bridge,  MA  0213d 
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Dr.  James  A.  Paulson 
Portland  State  University 
P.O.  Box  751 
Portland,  OR  97207 

Mr.  Luigi  Petrullo 
2431  N.  Pdgewood  Street 
Arlington,  VA  22207 

Dr.  Steven  M.  Pine 
4950  Douglas  Avenue 
Golden  Valley,  MN  55416 

Dr.  Peter  Poison 
Dept,  of  Psychology 
University  of  Colorado 
Boulder,  CO  80302 

Dr.  Diane  M.  Ramsey-Klee 
R-K  Research  and  System  Design 
3947  Ridgemont  Drive 
Malibu,  CA  90265 

Min.  Ret.  M.  Rauch 
P  II  4 

Bundesmlnisterium  Der  Verteidigung 
Postfach  161 
53  Bonn  1,  Germany 

Dr.  Peter  B.  Read 
Social  Science  Research  Council 
605  Third  Avenue 
New  York,  NY  10016 

Dr.  Mark  D.  Reckase 
Educational  Psychology  Dept. 
University  of  Mlssourl-Columbla 
14  Hill  Hall 
Columbia,  MO  65201 

Dr.  Fred  Reif 
SESAME 

c/o  Physics  Department 
University  of  California 
Berkely,  CA  94720 


Dr.  Andrew  M.  Rose 
American  Institutes  for  Research 
1055  Thomas  Jefferson  St.  NW 
Washington,  DC  20007 

Dr.  Leonard  L.  Rosenbaum,  Chairman 
Department  of  Psychology 
Montgomery  College 
Rockville,  MD  20850 

Dr.  Ernst  Z.  Rothkopf 
Bell  Laboratories 
600  Mountain  Avenue 
Murray  Hill,  NJ  07974 

Dr.  Donald  Rubin 
Educational  Testing  Services 
Princeton,  NJ  08450 

Dr.  Larry  Rudner 
Gallaudet  College 
Kendall  Green 
Washington,  DC  20002 

Dr.  David  Rumelhart 

Center  for  Human  Information  Processing 
Univ.  of  California,  San  Diego 
La  Jolla,  CA  92093 

Dr.  J.  Ryan 

Department  of  Education 
University  of  South  Carolina 
Columbia,  SC  29208 

Prof.  Fumiko  Samejlma 
Dept,  of  Psychology 
University  of  Tennessee 
Knoxville,  TN  37916 
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